arXiv: 1502.07077v2 [q-bio.QM] 26 Feb 2015 


Noname manuscript No. 

(will be inserted by the editor) 


Behavioral modulation of the coexistence between 
Apis melifera and Varroa destructor: A defense 
against colony colapse disorder? 


Joyce de Figueiro Santos • Flavio Codego 
Coelho • Pierre Alexandre Bliman 


Received: date / Accepted: date 


Abstract Colony Collapse Disorder has become a global problem for bee¬ 
keepers and for the crops which depend on bee polination. Multiple factors 
are known to increase the risk of colony colapse, and the ectoparasitic mite 
Varroa destructor that parasitizes honey bees is among the main threats to 
colony health. Although this mite is unlikely to, by itself, cause the collapse 
of hives, it plays an important role as it is a vector for many viral diseases. 
Such diseases are among the likely causes for Colony Collapse Disorder. 

The effects of V. destructor infestation are disparate in different parts of 
the world. Greater morbidity - in the form of colony losses - has been reported 
in colonies of European honey bees (EHB) in Europe, Asia and North America. 
However, this mite has been present in Brasil for many years and yet there 
are no reports of Africanized honey bee (AHB) colonies losses. 

Studies carried out in Mexico showed that some resistance behaviors to 
the mite - especially grooming and hygienic behavior - appear to be different 
in each subspecies. Could those difference in behaviors explain why the AHB 
are less susceptible to Colony Collapse Disorder? 

In order to answer this question, we propose a mathematical model of the 
coexistence dynamics of these two species, the bee and the mite, to analyze 
the role of resistance behaviors in the overall health of the colony, and, as a 
consequence, its ability to face epidemiological challenges. 
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1 Introduction 

Since 2007 American beekeepers reported heavier and widespread losses of 
bee colonies. And this goes beyond American borders — many Europeans 
beekeepers complain of the same problem. This mysterious phenomenon was 
called ’’Colony Collapse Disorder” (CCD) — the official description of a syn¬ 
drome in which many bee colonies died in the winter and spring of 2006/2007. 
Diseases and parasites, in-hive chemicals, agricultural insecticides, genetically 
modified crops, changed cultural practices and cool brood are pointed as some 
of the possible causes for CCD (Oldroyd, 2007). 

The ectoparasitic mite Varroa destructor that parasitize honey bees has 
become a global problem and is considered as one of the important burdens 
on bee colonies and a cause for CCD. The Varroa mite is suspected of having 
caused the collapse of millions of Apis mellifera honey bee colonies worldwide. 
However, the effects caused by V. destructor infestation vary in different parts 
of the world. More intense losses have been reported in European honey bee 
colonies (EHB) of Europe, Asia and North America (Caldern et al, 2010). 

The life cycle of V. destructor is tightly linked with the bee’s. Immature 
mites develop together with immature bees, parasitizing them from an early 
stage. The mite’s egg-laying behavior is coupled with the bee’s and thus de¬ 
pends on its reproductive cycle. Since worker brood rearing and thus Varroa 
reproduction occurs all year round in tropical climates, it could be expected 
that the impact of the parasite would be even worse in tropical regions. But 
Varroa destructor has been present in Brazil for more than 30 years and yet 
no collapses due to this mite, have been recorded (Carneiro et al, 2007). It 
is worth noting that the dominant variety of bees in Brazil is the Africanized 
honey bee (AHB) which since its introduction in 1956, has spread to the entire 
country(Pinto et al, 2012). 

African bees and their hybrids are more resistant to the mite V. destructor 
than European bee subspecies (Medina and Martin, 1999; Pinto et al, 2012). A 
review by Arechavaleta-Velasco and Guzman-Novoa (2001) in Mexico showed 
that EHB was twice as attractive to V.destructor than AHB. The removal of 
naturally infested brood, which is termed hygienic behavior, was reported as 
four times higher in AHB than in EHB, and AHB workers were more efficient 
in grooming mites from their bodies. 

These behaviors are important factors in keeping the mites infestation low 
in the honey bee colonies. 


1.1 Resistance behaviors of the bee against the parasite 

Two main resistance behaviors, namely grooming and hygienic behavior(Spivak, 
1996), are mechanisms employed by the honey bees to control parasitism in 
the hive. 
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The grooming behavior is when a worker bee is able to groom herself with 
her legs and mandibles to remove the mite and then injure or kill it. (Vandame 
et al, 2000). 

Hygienic behavior is a mechanism through which worker bee broods are 
uncapped leading to the death of the pupae. This behavior is believed to 
confer resistance to Varroa infestation since worker bees are more likely to 
uncap an infested brood, than an uninfested one. It has been demonstrated 
that the smell of the mite by itself is capable of activating this behavior. 
(Corra-Marques et al, 1998). 

The hygienic behavior serves to combat other illnesses or parasites to 
which the brood is susceptible. It is also not a completely accurate mecha¬ 
nism. Correa-Marques and De Jong (1998), report that the majority (53%) 
of the uncapped cells display apparently no signs of parasitism or other ab¬ 
normality which would justify the killing of the brood. Thus, in our model 
we define two parameters for the hygienic behavior: H s , for the generic hy¬ 
gienic behavior, which may kill uninfested pupae, and h for the sucess rate in 
uncapping infested brood cells. 

Africanized honey bees have been shown to be more competent in hygienic 
behavior than European honey bees. Vandame et al (2000) found in Mexico 
that the EHB are able to remove just 8% of infested brood while AHB removed 
up 32.5%. 

The main goal of this paper is to propose a model capable of describing 
the dynamics of infestation by V. destructor in bee colonies taking into con¬ 
sideration bee’s resistance mechanisms to mite infestation — grooming and 
hygienic behavior. In addition, through simulations, we show how the resis¬ 
tance behaviors contribute to the reduction infestation levels and may even 
lead to the complete elimination of the parasite from the colony. 


2 Mathematical model 

Previous work by Ratti et al (2012) models the population dynamics of bee 
and mites together with the acute bee paralysis virus. Here we focus solely on 
the host-parasite interactions trying to understand the resilience of colonies 
in Brazil and the role of the more efficient resistance behaviors displayed by 
AHB to explain the lower infestation rates and incidence of collapses in their 
colonies. 

Vandame et al (2002) discusses the cost-benefit of resistance mechanism of 
bee against mite. The grooming behavior performed by adult bees, includes 
detecting and eliminating mites from their own body (auto-grooming) or from 
the body of another bee (allo-grooming). The hygienic behavior occurs when 
adult bees detect the presence of the mite offspring still in the cells and in 
order to prevent the mites from spreading in the colony, the worker bees kill 
the infested brood. Their study compared the results for two subspecies of 
bees - Africanized and European - to examine whether these two mechanisms 
could explain the observed low compatibility between Africanized bees and 
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Fig. 1 Diagram to describes the dynamics of the model. 


the mite Varroa destructor , in Mexico. The results showed that grooming and 
hygienic behavior appears most intense in Africanized bees than in Europeans 
bees. 

The model proposed is shown in the diagram of figure 1, and detailed in 
the system of differential equations below: 


/ = 7T- 


A 


A + A, 

A = SI + gAi — nA 


-51-HI 


j, = 7T—--- 5Ii — Hili 

A + Ai 

Ai = 5Ii - gAi - (/x + 7 )At 


(1) 


In the proposed model, I, Ii, A and A, represent the non-infested immature 
bees, infested immature bees, non-infested adult worker bees and infested adult 
worker bees, respectively. 

Daily birth rate for bees is denoted by 7r, 5 is the maturation rate, i.e., 
the inverse of number of days an immature bee requires to turn in adult, this 
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rate is the same for both infested and non-infested immature bees, /i is the 
mortality rate for adult bees ,7 is the mortality rate induced by the presence 
of mites in the colony bees. The parameters H il H eg are the rate of removal 
of infested pupae via hygienic behavior, the general hygienic rate (affecting 
uninfested pupae) and grooming rate, respectively. 


Table 1 Parameters of the model. 


Parameters 

Meaning 

Value 

Unit 

Reference 

7T 

Bee daily birth rate 

2500 

bees X day —1 

Pereira et al, 2002 

<5 

Maturation rate 

0.05 

day —1 

Pereira et al, 2002 

H 

Generic hygienic behavior 

- 

day —1 

- 

Hi 

Hygienic behavior towards infested brood 

- 

day —1 

- 

9 

Grooming 

- 

day —1 

- 


Mortality rate 

0.04 

day —1 

(Khoury et al, 2011) 

7 

Mite induced mortality 

10- 7 

day —1 

(Ratti et al, 2012) 


Choosing parameters 

Some of the parameters associated with the bees life cycle, used for the sim¬ 
ulations, can be found in the literature, as shown in table 1. For the resis¬ 
tance behavior parameters, g, H and Hi , very little information is available. 
Therefore we decided to study the variation of these parameters within ranges 
which allowed for the system to switch between a mite-free equilibrium to one 
of coexistence. These ranges also reflected observations described in the liter¬ 
ature (Mondragn et al, 2005; Vandame et al, 2002; Arechavaleta-Velasco and 
Guzman-Novoa, 2001). 


Table 2 Varying the parameters 


Parameter 

Maximum value 

Minimum value 

9 

0.01 

0.1 

Hi 

0.08 

0.4 

H 

0.04 

0.2 


The three unknown parameters representing resistance behaviors g, Hi, H 
- grooming, proper hygienic behavior and wrong hygienic behavior - where 
studied with respect to the existence of a coexistence equilibrium. 


3 Results 

In order to understand the dynamics of the proposed model of mite infestation 
of bee colonies, we proceed to analyze it. 
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Fig. 2 plot of values of 711 o for a range of values of g and H. Hi = 0.01 and remaining 
parameters set as described in table 1. The region in red corresponds to IZo > 1, the black 
line to 7Ho = 0 and the blue region otherwise. 


3.1 Basic reproduction number of the infested bees 

An effective way to look at boundary beyond which coexistence of mites and 
bees is possible, is to look at the TZq of infestation. For our model, the basic 
reproduction number, or of infested bees, can be thought of as the number 
of new infestations that one infested bee when introduced into the colony 
generates on average over the course of its infestation period or while it is not 
groomed, in an otherwise uninfested population. 

Deriving IZq using the next generation method: To calculate the basic re¬ 
production number of infested bees, we will use the next-generation matrix 
(Van den Driessche and Watmough, 2002), where the whole population is di¬ 
vided into n compartments in which there are to < n infested compartments. 

In this method, 1Z 0 is defined as the spectral radius, or the largest eigen¬ 
value, of the next generation matrix. 

Let Xi, i = 1, 2..., to. be the number or proportion of individuals in the ith 
compartment. Then 

If = ?i{x) - Vi(x) 

where V) (x) is the rate of appearance of new infections in compartment i and 
Vi (a:) = V“(x) — V i + (a;). Where V” is the rate of transfer of individuals out 
of the ith compartment, and V 4 + represents the rate of transfer of individuals 
into compartment i by all other means. 
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Fig. 3 Values of IZo for various combinations of Hi and H. g = 0.01 and other parameters 
as given in table l.The region in red corresponds to IZq > 1, the black line to IZo = 0 and 
the blue region otherwise. This figure illustrates one of the conditions for coexistence(given 
other parameters values fixed as in table 1) that H must be larger than Hi. 


The next generation matrix is then defined by FV 1 , where F and V can 
be formed by the partial derivatives of Ti and V*. 

F = [^f 1 ] and V = [^p 1 ] 

where Xq is the disease free equilibrium. 

In our model, m = 2 and the infested compartments are: 


dli 


Ai 


- SL - HI, 


dt A + Ai 

= sii - gAi - (/x + 7 )Ai 


( 2 ) 


Now we write the matrices F and V , substituting the mite-free equilibrium 


values, A* = ^s+h) an< ^ A* = 0. 


F = 


0 i^+di) 
0 0 


V = 


6 + Hi 0 

-5 g + 'y + n 


Let the next-generation matrix G be the matrix product FV 1 . Then 
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G = 


g(S+H) g(S+H) 

(S+Hi)(g+j+/j,) 6(g+y+g) 

0 0 


Now we can find the basic reproduction number, TZq, which is the largest 
eigenvalue of the matrix G. 


fj,{5 -f- H) 

(6 + H.i){g + 7 + /t) 


( 3 ) 


Hi 

0.09 

0.08 

0.07 

0.06 

0.05 

0.04 

0.03 

0.02 

0.01 

0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 



Fig. 4 Implicit plot for TZo letting g and II, vary. Using the values for parameters n , S, ji and 
7 from table 1 The red region represent 77p > 1 which means that for these combination of g 
and Hi the mite will stay in the colony. On the other hand, the blue region represents 77o < 1 
which means that for these these combination of g and Hi the mites will be eliminated. 


Figures 2, 3 and 4 show the boundary between mite-free (blue region, 
TZq < 1) and coexistence equilibria (red region, Hq > 1). 
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3.2 Well-Posed and Boundedness 
For sake of simplicity, we denote 

a = 5 + H , on = 5 + Hi , ^ = g + 7 (4) 

in such a way that the system ( 1 ) rewrites 


A 

I = 7T— --- al 

A + Ai 

(5a) 

A = 51 — hA + gAi 

(5b) 

Ai 

(5c) 

Ij — 7T Otjlj 

Ai = <5/,: — (Hi + </)Ai 

(5d) 


We assume that all the coefficients presented in table 1 are all positive, that 
is: 

7 r, 6, h > 0, a, a, > 6, Hi > l L • ( 6 ) 

The previous system of equations is written 

X = f(X), X=(I,A,Ii,Ai ) (7) 

The right-hand side of (7) is not properly defined in the points where A + A,; = 

0. However, the following result demonstrates that this has no consequence on 
the solutions, as the latter stays away from this part of the subspace. For 
subsequent use, we denote V the subset of those elements X = (/, A, I it A,) e 
such that A + Aj ^ 0. 

Theorem 1 (Well-posedness and boundedness). If X 0 € V, then there exists 
a unique solution of (7) defined on [0, + 00 ) such that V(0) = Xq. Moreover, 
for any t > 0, X(t) € V, and 

77 < liminf(/(i) + h(t)) < limsup(/(f) + lift)) < — (8a) 

C^max t->+00 t-y-|-oo Ctmin 

c r 

-—— < liminf(A(t) + AAt)) < limsup(A(t) + AAt)) < —(8b) 

Hid max t-y+oo V t^+00 HO: min 

where by definition a m i n = min{a;ai}, a max = max{a; cti}. A/so, 

-- — - EWXm in < limin f J( t ) } -L-< lim inf Aft) 

(O! Of. min)/^ + /^i^max t—>-+oo (CH ^min)/^ H - M«^max t—>-+oo 

(9) 

and 

(7,(0), Ai(0)) + (0,0) =» Vi > 0, h{t) > 0, Ai(t) > 0 (10) 
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Define V as the largest set included in V and fulfilling the inequalities of 
Theorem 1, that is: 


V = : 


'KQU'OL min 


< L 


5nqa . n i r 

—-— < A < I + L < 


/^i^max /li^max 

Sir 


fJ'iCX n 


< A -1 - Ai ^ 


*max 

Sir 

ftCX. min 


Ct n 


■ (ii) 


Theorem 1 shows that the compact set T>' is positively invariant and attracts 
all the trajectories. Therefore, in order to study the asymptotics of system (5), 
it is sufficient to consider the trajectories of (5) that are in V. 


3.3 Equilibria 


Theorem 2 (Equilibria and asymptotic behavior). Define 


p ^ ffi _ Vi +9 
at a 


( 12 ) 


• If ft < 0, then there exists a unique equilibrium point of system (7) 
that corresponds to a mite-free situation. It is globally asymptotically 
and given by 


Xmf = ~ 
a 


( l f\ 

0 

Vo J 


in V, 
stable, 


(13) 


• If ft > X, then there exists two equilibrium points in V, namely Xmf and 
a coexistence equilibrium defined by 


Xco 


Sirg _ an - afim + g) 

aftpi + g) a(n + g) - a,:(/q + g) 


/I ad/U+g) \ 
I <5 a/i-ctiiiH+g) \ 


V 


aii-adia+g) 

Fi+g 

S f 

9 


) 


(14) 


Moreover, for all initial conditions in V except in a zero measure set, the 
trajectories tend towards Xco- 


Recall that 1Z 0 = a , in such a way that 


ft > 0 TZo > 1 . 


(15) 


The point TZq = 1, that is ft = 0, is the point of a transcritical bifurcation, 
that appears when TZq gets larger than 1. For larger values, two equilibria are 
found analytically, a mite-free one, that is unstable, and a coexistence equi¬ 
librium which is stable. We’ve shown (Theorem 2) that the latter is globally 
asymptotically stable if ft > —, and conjecture that the same property holds 
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Fig. 5 Bifurcation diagram showing the transcritical bifurcation with bifurcation point 
corresponding to a ps 0.125 (/3 = 0, Tt-o = 1). Blue dots correspond to the equilibrium values 
of h 


for j3 in the interval (0, — ]. Using a as bifurcation parameter, the bifurcation 
appears for a = ss 0.125, after substituting the parameter values. 

If we solve numerically the system from (5), we confirm the existence of 
two equilibria when a crosses the bifurcation value of 0.125. The instability 
and stability of the mite-free and coexistence equilibria, respectively is shown 
in the simulation of figure 6. 

Figures 6 and 7 show simulations representing the coexistence and mite-free 
equilibria, respectively. 


4 Discussion and Conclusions 

Coexistence of bees and Varroa mites in nature is an undeniable fact. However, 
this coexistence is fraught with dangers for the bees, since Varroa mites can be 
vectors of lethal viral diseases. These deleterious effects for the health of the 
individual workers and the whole colony, has led to the evolution of resistance 
behaviors such as the hygienic behavior and grooming. 

Those behaviors are not entirely without cost to the bees, exacerbated 
hygienic behavior - when both H and Hi are intensified - can exert a sub- 
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Bees 



Fig. 6 Simulation showing the infestation of a colony, by a single infested adult bee, with 
parameters giving TZo rj 1.33. Initial conditions: I = 5000, l, = 0, A = 20000, A t — 0 and 
parameters g = 0.01, Hi = 0.1, fi = 0.04, S = 0.05, 7 = 10 ~ 7 and H = 0.19. On time 
t = 100 days, a single infested adult bee is introduced into the colony. For this simulation, 
/3 = 0.375 and 1Z 0 ~ 3.199 


stantial toll on the fitness of the queen. So it is safe to say that this parasitic 
relationship has evolved within a vary narrow range of parameters. Even if the 
mite-free equilibrium is advantageous to the colony, maintaining it may be too 
expensive to the bees. 

[we need some discussion regarding the conditions for stability of Xmf , or 
the invasibility of the colony by mites] 

On the other hand, in the absence of viral diseases, mite parasitism seems 
to be fairly harmless. If we look at the expression for the IZq of infestation 
(3), we can see that the mite-induced bee mortality, 7 , (not by viral diseases), 
must be kept low or risk destabilizing the co-existence equilibrium. 

Africanized Honey bees, having evolved more effective resistance behav¬ 
iors, are more resistant to CCD by their ability to keep infestation levels lower 
than those of their European counterparts(Moretto et al, 1991, 1993). Unfortu¬ 
nately, the lack of more detailed experiments measuring the rates of grooming 
and higienic behaviors in both groups (EHB and AHB), makes it hard to 
position them accurately in the parameter space of the model presented. 
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Bees 



Fig. 7 Simulation showing the elimination of the mites from a colony, by a single infested 
adult bee, when Ro < 1. Initial conditions: I = 15000, I, = 5000, A = 20000, /l, = 6000 
and parameters g = 0.01, Hi = 0.1, g = 0.05, 6 = 0.05, 7 = 10 -7 and H = 0.1. 


Finally, we hope that the model presented here along with its demonstrated 
dynamical properties will serve as a solid foundation for the development of 
other models including viral dynamics and other aspects of bee colony health. 


5 Appendix — Proofs of the theorems 

Proof of Theorem 1. • Clearly, the right-hand side of the system of equations 
is globally Lipschitz on any subset of T) where A + Ai is bounded away from 
zero. The existence and uniqueness of the solution of system (5) is then ob¬ 
tained for each trajectory staying at finite distance of this boundary. We will 
show that the two formulas provided in the statement are valid for each tra¬ 
jectory departing initially from a point where A + Aj 7 ^ 0. As a consequence, 
the fact that all trajectories are defined on infinite horizon will ensue. 

• Summing up the first two equations in (5) yields, for any point inside T>: 

I + Ii = ir - ai - aJi >7 r - a max (I + Ii) . (16) 

Integrating this differential inequality between any two points X (0) = Xq and 
X(t) of a trajectory for which X{r) S D, r S [0;t], one gets 

I(t) + lift) > — — (l - e _ “ maxt ) + (1(0) + Ii( 0))e -QWxt , (17) 

^max 

where the right-hand side is in any case positive for any t > 0 . 
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Similarly, one has 

/ + /,;< 7T — a m i n {I + h) , (18) 

and therefore 

I(t) + Ii(t ) < —— (l - e _ “ min< ) + (1(0) + Ii( 0))e _amint . (19) 

^min 

This proves in particular that the inequalities in ( 8 a) hold for any portion of 
trajectory remaining inside V. 

We now consider the evolution of A, A t . Similarly to what was done for 
/, Ii, one has 

A + A-i = 5(1 + Ii) — fxA — HiAi > 5(1 + /,;) — Hi(A + Ai) (20) 
Therefore, 

A(t) + Mt) > (A(0) + M0))e~^ + 5 f(I( T ) + 7 i (r))e-^( t -"). dr . (21) 

Jo 

Integrating the lower bound of I+ Ii extracted from (17) yields the conclusion 
that any solution departing from T> indeed remains in T> as long as it is defined. 
On the other hand, we saw previously that trajectories remaining in V could be 
extended on the whole semi-axis [0, +oo). Therefore, any trajectory departing 
from a point in T) can be extended to [0, +oo), and remains in T> for any t > 0. 
In particular, ( 8 a) holds for any trajectory departing inside V. 

Let us now achieve the proof by bounding A + Ai from above. One has 

A + Ai < 6(1 + Ii) — n(A + Ai) (22) 


and thus 


A(t) + Ai(t) < (71(0) + Ai(0))e~^ + 5 f (I(t) + / 4 (r))e-^- T ). dr . (23) 

Jo 

Using (19) then permits to achieve the proof of ( 8 b), and finally the proof of 

( 8 ). 

• Let us now prove (9). One deduces from (5a) and (5b) and the bounds 
established earlier the differential inequalities 


I > 


lim sup(7l + Ai) 


A-aI> t^A-al, 


A> 51 — fj,A + <jf(liminf(7l + Ai) — A) > 51 — (/i + g)A + 

The auxiliary linear time-invariant system 

d fI'\ (-a \ (I' 

Jt U' 


Sng 


8 -O + g)J V 4 ' 


+ ( Sng 

[l-iOC max 


(24a) 

(24b) 

(25) 
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is monotone, as the state matrix involved is a Metzler matrix (?). Moreover, 
it is asymptotically stable, as the associated characteristic polynomial is equal 
to 


s + ct 
—<5 s + n + g 


s 2 + (a + n + g)s + a(fi + g) - 


(26) 


and thus Hurwitz because a(n + g) — y,a m i n = (a —ct m i n )n + ag > 0. Therefore, 
all trajectories of (25) tend towards the unique equilibrium: 


lim 

£—>■ +00 




M«mi. \ 1 

-(p + g)J 



1 fg + g 

(c^ Q^min )n + ag \ 6 a 


1 

(oi ^min )g, + ag 


TTff/XQ! min 
Mi^max 

dnga 



(27) 


Invoking Kamke’s Theorem, see e.g. (Coppel, 1965, Theorem 10, p. 29), one 
deduces from (24) and the monotony of (25) the following comparison result, 
that holds for all trajectories of (31): 


lim inf 

£—>•+00 



> 


/ Trgpctmin s 
| Mi^max 


(a - a min )/x + ag y 


This gives (9). 

• One finally proves (10). Using (8b), identity (5c) implies 


h > 


lim sup {A + Ai) 


Aj ^ 


flO!. n 


-Aj — otili 


(28) 


(29) 


Joining this with (5d) and using Kamke’s result as before, ones deduces that 
both /, and Ai have positive values when at least one of their two initial values 
are positive. This achieves the proof of Theorem 1. □ 


Proof of Theorem, 2. The proof is organized as follows. 

1. We first write system (5) under the form of an I/O system, namely 


A 

I = 7r—--- ai 

A + Ai 

(30a) 

A = 61 — fiA + u 

(30b) 

T „ + 1 

1 j — 7T . Qij 1 j 

A + Ai 

(30c) 

Ai = 5Ii — (/q + g)Ai 

(30d) 

y = gAi 

(30e) 


where u, resp. y, is the input, resp. the output, closed by the unitary 
feedback 

u = y . (30f) 
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For subsequent use of the theory of monotone systems, one determines, for 
any (nonnegative) constant value of u, the equilibrium values of (/, A , A, Ai) 
for equation (30a)-(30d), and the corresponding values of y as given by 
(30e). 

2. The equilibrium points of system (5) are then exactly (and easily) ob¬ 
tained by solving the fixed point problem u = y among the solutions of the 
previous problem. 

unique equilibrium points when f3 < 0, and there exist exactly two equi¬ 
librium points when /3 > 0. points. 

3. One then shows that the I/O system u >->• y defined by (30a)-(30e) is 
anti-monotone with respect to certain order relation, and the study of the 
stability of these equilibria shows that it admits single-valued I/S and I/O 
characteristics, as in (Angeli and Sontag, 2004). 

4. Using this properties, the stability of the equilibria of the system obtained 
by closing the loop (30a)-(30e) by (30f) is then established using arguments 
similar to Angeli and Sontag (2003). 


1. For fixed u > 0, the equilibrium equations of the I/O system (30) are given 
by 



^4 

7T—--- al = 0 

A + Ai 

(31a) 


SI — yA + u = 0 

(31b) 


A-i T n 

7r—- t- aslj = U 

A + Ai 

(31c) 


Sli - (y i + g)Ai = 0 

(31d) 


II 

(31e) 

Summing up the first and third identities gives 



7T — Oil ~\~ OLili , 

(32) 

and thus necessarily: 



3A € [0; 1], 

7r 7 r 

I = A—, /< = (1-A)— . 

a Oil 

(33) 


• The case A = 0 yields 1 = 0, and then A = 0 by (31a), and therefore u 

has to be zero from (31b). Also, A,; = Q . t^-+ g ) by (31d), and then 

y = gA = a ■ Ur+g) • (11) an< l should be discarded, obtained point is located 

outside V and has to be discarded; or 

• The case A = 1 yields /, = 0, and then A, = 0 by (31d) or (31c), and 
y = 0. There remains the two following conditions: 

7r = al, SI = yA — u (34) 

T 7r A 5n u 

I = —, A =- 1 — 

a ay y 


which yield 


(35) 
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unconditionally. 

• Let us now look for possible values of A in (0; 1). From (33) and (31a)- 
(31c), one deduces 


A_ _ od_ _ A 
A[ Olili 1 A 


(36) 


Using (33) on the one hand and summing the two identities (31b)-(31d) on 
the other hand, yields 


S(I+Ii) = Stt ( —b 


a.j 


= /j,A+(ni+g)Ai-u = A( g + (gi + g) 


1 — A 


— u. 
(37) 


This permits to express A as a function of A, namely: 


A/i + (1 — \)(gi + g) 

Using this formula together with (33), (31d) and (36) now allows to find an 
equation involving only the unknown A, namely: 


Stt 


a 


1 - A 

Oii 


(38) 


fisj r A ■ 

Sli = —(1 - A) = (ni + g)Ai = (ni + g)-^-A 

Oil A 


= (Mi + 9 ) 


1-A 


A 


A Xg + (1 — + g) [ 

Simplifying (as A yf 0,1) gives: 


i A 1 — A 

Sn ( - +- 

a a.i 


+ u 


Stt 


Mi + 9 


Am + (1 - ^)(Mi + 9) V 


1 A 1 — A 
Sn [ —b 


a OLi 


The previous condition is clearly affine in A. It writes 


Stt 


(Am + (1 - a + g)) — = (m+g) (Stt ( - + 


Oii 


A 1 - A 


Ois 


which, after developing and simplifying, can be expressed as: 


Stt 


Xg — = (Mi + 9) Stt- + 


A 


and finally 


/ , X r , M Mi +9 

(,Mi + 9)u = Stt \ - 


A = Stt(3X . 


ai a 

For u > 0, this equation admits a solution in (0; 1) if and only if 

Stt/3 


(3 > 0 


and 


u < u = 


Mi +g 


(39) 

(40) 

(41) 

(42) 

(43) 

(44) 


A = 


Mi + 9 
Stt p 


u . 


and the latter is given as 


(45) 
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The state and output values may then be expressed explicitly as functions of 
u. In particular, one has 


y(u) = gAi 


Vi+g aAHi+g) 


fag L _ im +g A 
ai{Hi+g)\ fa/3 ) 


(46) 

• (31) admits exactly one solution in V for any u > 0; admits a supple¬ 
mentary solution in T>' for any u £ [0; u*). The following tables summarize the 
number of solutions of (31) for all nonnegative values of u. 


Values of u > 0 

Number of distinct solutions of (31) 

u = 0 

2 

0 < u 

1 


Fig. 8 K 0 < 1 (i.e. 0 < 0). 


Values of u > 0 

Number of distinct solutions of (31) 

u = 0 

3 

0 < u < u* 

2 

u* < u 

1 


Fig. 9 7£o > 1 (i-e. /3 > 0). 


2. The equilibrium points of system (5) are exactly those points for which 
u = y{u) for some nonnegative scalar u , where y(u) is one of the output values 
corresponding to u previously computed. We now examine in more details the 
solutions of this equation. 

• For the value A = 0 in the previous computations, one should have u = 0, 
due to (45); but on the other hand y > 0 for u = 0, due to (46). Therefore 
this point does not correspond to an equilibrium point of system (31). 

• The value A = 1 yields a unique equilibrium point. Indeed, y = 0, so u 
should be zero too, and the unique solution is given by 

7r SlT 

1= A= —, li = 0, Ai = 0, y = 0 . (47) 

a ag 


This corresponds to the equilibrium denoted Xmf in the statement. 

• Let us consider now the case of A G (0; 1). For this case to be considered, 
it is necessary that 8 > 0, that is TZq > 1. The value of u should be such that 
(see (46)) 


y = 


fag 


cq(/q+g) cq/3 


u = u 


(48) 



fag 

ai(yi+g) 


that is 


u = 


(49) 
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or again 


dn/3g 

{otifi + g){m + g) 


S^g _ ay - ai(ni + g) 

oti(in + g) a(n + g) - + g) 


(50) 


after replacing ft by its value defined in (12). The corresponding value of 


> Mi + 9 g 

A = ——— u = —-- , 

5ir/3 a. t p + g 


(51) 


given by (45), is clearly contained in (0; 1) when p > 0. Therefore, when p > 0, 
there also exists a second equilibrium. The latter is given by: 


7 r m+g 1 on{in+g) 

I = x - = +sF u = 


a 


5 an - a l (n i + g) 

g 


A, = 


I, = = * 


a =!(«+») = if °- 1 b + -' 7) , 

n n \oin - (*i\ni + g) 


$g 

+1 ^ u = 


an - c*i(ni + g) 


u , 


(52a) 

(52b) 

(52c) 


and corresponds to Xqo defined in the statement, 
diagonal that comes from the loop closing. 

3. Let K, be the cone in R% defined as the product of orthants IR._|_ x IR._|_ x 
M_ x R_. We endow the state space with this order. In other words, for any 
X = (I,A,Ii,Ai) and X' = {!', A' ,V() in Mf}, X X' means: 


I < I', A < A!, 


h > I' i ,A l > A\ . 


(53) 


With this structure, one may verify that the system (30a)-(30e) has the fol¬ 
lowing monotonicity properties (Hirsch, 1988; Smith, 2008) 

— For any function u € U = {u : [0; + 00 ) —» M, locally integrable and taking 
on positive values almost everywhere}, for any Vo, Vf, £ Mi}, 

X 0 <K X’ G =► Vi > 0, V(t; V 0 , u) < K V(i; V', u) (54) 

where by definition V(t; Vo,it) denotes the value at time t of the point in 
the trajectory departing at time 0 from Vo and subject to input u. 

— The Jacobian matrix of the I/O system is 

(~ a 77 (A+Ai) 2 0 

s —n 0 

0 77 (A+Ai) 2 ~ a i 

V 0 0 s 

which is irreducible when J / 0 and dj / 0. The system is therefore 
strongly monotone in V \ {X : Ai = 0} (notice that V does not contain 
points for which A = 0), and also on the invariant subset V 0 {V : = 

0, Ai =0,}. 


" (A+Ai) 2 

0 

„ A 
n (A+A t ) 2 

-(Mi + g) J 


(55) 
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— The input-to-state map is monotone, that is: for any inputs u.u' € U , for 

.nyX^K, 

u(t) < u'(t) a.e. => Vt > 0, X(t;Xo,u) <% X(t;X' 0 ,u) . (56) 

— The state-to-output map is anti-monotone, that is: for any X,X' £ Mi, 

X < K X' => \/t > 0, gAi > gA'i (57) 


monotone (due to the irreducibility of the Jacobian matrix) for any con¬ 
stant value of u. 

• In order to construct I/S and I/O characteristics for system (31), we now 
examine the stability of the equilibria of system (31) for any fixed value of 
u £ K_|_, As shown by Theorem 1, all trajectories are precompact. 

• When /3 < 0, it has been previously established that for any u £ M there 
exists at most one equilibrium in V to the I/O system (31). The strong mono¬ 
tonicity property of this system depicted above then implies that this equi¬ 
librium is globally attractive (Hirsclr, 1988, Theorem 10.3). Therefore, system 
(31) possesses I/S and I/O characteristics. As for any value of u, this equi¬ 
librium corresponds to zero output, the I/O characteristics is zero. Applying 
the results of Angeli and Sontag (2004), one gets that the closed-loop system 
equilibrium Xmf is an almost globally attracting equilibrium for system (5). 

• Let us now consider the case where /3 > 0. We first show that the equi¬ 
librium point with /, = 0, Ai = 0 and (34) is locally unstable. Notice that this 
point is located on a branch of solution parametrized by u and departing from 
Xmf for u — 0. The Jacobian matrix (55) taken at this point is 


/—a 0 0 

5 —g 0 
0 0 —a* 

\ 0 0 6 


flOL 7T \ 

5n-\-cni \ 

o 

[MATT 

StT-\-(AU 

-(w + g)J 


(58) 


This matrix is block triangular, with diagonal blocks 



and 



fiair 

8'K-\-OiU 

-(m* + fl) 


(59) 


The first of them is clearly Hurwitz, while the second, whose characteristic 
polynomial is 


fJjGiS 7T 

s 2 +(a i +g i +g)s+a l (g l +g )---= s 2 +(ai+gi+g)s-aai(l3-u(gi+g )) 

of + au 

= s 2 + ( ai + Pi + g)s — aatigi + g)(u* — u ) (60) 

(where u* is defined in (44)) is not Hurwitz when /3 > 0 and 0 < u < u*, and 
has a positive root for 0 < u < u*. Therefore, the corresponding equilibrium 
of the I/O system (30) is unstable for these values of u. 

The other solution, given as a function of u by (52), is located on a branch 
of solution parametrized by u and departing from Xqo fo r u = 0. As the 
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other solution is unstable for 0 < u < u*, one can deduce from Hirsch (1988, 
Theorem 10.3) that these solutions are locally asymptotically stable. 

• One may now associate to any u £ [0;«*] the corresponding unique 
locally asymptotically stable equilibrium point, and the corresponding output 
value, defining therefore respectively an I/S characteristic kx and an I/O 
characteristic k for system (30). 

For any scalar u £ [0;it*], for almost any X 0 £V', one has 

lim X(t; Xo, u) = kx(u), lim y(t] Xq, u) = k(u) , (61) 

t —>-+oo t —>-+oo 

and, from the monotony properties, for any scalar-valued continuous function 
u, for almost any X 0 £ T>'\ 

k ( limsupw(t) ) < lim inf y{t\ Xq, it) < lim sup y(t\X 0 ,u) < k ( lim inf u(t) 

V t-H-oo ) t->+ OO t-H-oo yt-H-oo 

( 62 ) 

Using the fact that k is anti-monotone and that u = y for the closed-loop 
system, one deduces, as e.g. in Gouze (1988) that, for the solutions of the 
latter, 



k 21 niminf y(f; Vq, u) j < liminf y(t\ Xq, u) < limsupy(t; Xq, u) < k 21 ^limsup y(t; Xq, u) 


t—y -|-oo 


t—>■+ OO 


\ t — y -|-oo 


Here k(u), defined by (46), is a linear decreasing map. When its slope is 
smaller than 1, then the sequences in the left and right of (63) tend towards 
the fixed point that corresponds to the output value at X = Xco, see (50). 

This slope value, see (46), is equal to 

Sn 9 fo +ff = J_ ) (64) 

otiiHi+g) Sirf3 ai/3 

and it thus smaller than 1 if and only if /? > —, which is an hypothesis of the 
statement. 

Under these assumptions, one then obtains that the liminf and lim sup in 
(63) are equal, and thus that y, and thus u, possesses limit for t —> +00. More¬ 
over, the state itself converges towards the equilibrium Xco when t +00 
for almost every initial conditions V(0). This achieves the proof of Theorem 
2 . " □ 
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